Partially observable multistage stochastic programming
نویسندگان
چکیده
منابع مشابه
Dynamic Programming for Partially Observable Stochastic Games
We develop an exact dynamic programming algorithm for partially observable stochastic games (POSGs). The algorithm is a synthesis of dynamic programming for partially observable Markov decision processes (POMDPs) and iterative elimination of dominated strategies in normal form games. We prove that it iteratively eliminates very weakly dominated strategies without first forming the normal form r...
متن کاملDynamic Programming Approximations for Partially Observable Stochastic Games
Partially observable stochastic games (POSGs) provide a rich mathematical framework for planning under uncertainty by a group of agents. However, this modeling advantage comes with a price, namely a high computational cost. Solving POSGs optimally quickly becomes intractable after a few decision cycles. Our main contribution is to provide bounded approximation techniques, which enable us to sca...
متن کاملActing Optimally in Partially Observable Stochastic Domains
In this paper, we describe the partially observable Markov decision process (pomdp) approach to nding optimal or near-optimal control strategies for partially observable stochastic environments, given a complete model of the environment. The pomdp approach was originally developed in the operations research community and provides a formal basis for planning problems that have been of interest t...
متن کاملRamsey Stochastic Model via Multistage Stochastic Programming
Ramsey model belongs to “classical” economic dynamic models. It has been (1928) originally constructed (with a farmer’s interpretation) in a deterministic discrete setting. To solve it Lagrangean or dynamic programming techniques can be employed. Later, this model has been generalized to a stochastic version. Time horizon in the original deterministic model as well as in modified stochastic one...
متن کاملEecient Dynamic-programming Updates in Partially Observable Markov Decision Processes Eecient Dynamic-programming Updates in Partially Observable Markov Decision Processes
We examine the problem of performing exact dynamic-programming updates in partially observable Markov decision processes (pomdps) from a computational complexity viewpoint. Dynamic-programming updates are a crucial operation in a wide range of pomdp solution methods and we nd that it is intractable to perform these updates on piecewise-linear convex value functions for general pomdps. We offer ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Operations Research Letters
سال: 2020
ISSN: 0167-6377
DOI: 10.1016/j.orl.2020.06.005